^ 



X) 



\o 



en 



X 



I. INTRODUCTION 



Direct coupling and inhomogeneity assist neurons to detect correlation in low 

amplitude noises 

E. Bolhasani, Y. Azizi, and A. Valizadeh 
Institute for Advanced Studies in Basic Sciences, P.O. Box 45195-1159, Zanjan, Iran 

We address a question on the efTect of common stochastic inputs on the correlation of the spikes 
trains of two neurons when they are possibly nonidentical and are coupled through direct connec- 
tions. We show that the change in the correlation of low amplitude stochastic inputs can be better 
detected when the neurons are connected by direct excitatory couplings. Depending on whether 
the neurons are identical or they are slightly different, symmetric or asymmetric connections can 
- - - increase the sensitivity of the system to the input correlation by changing the mean slope of cor- 

m , relation transfer function over a given range of input correlation. In either case, there is also an 

^~~^ . optimum value for synaptic strength which maximizes the sensitivity of the system to the changes 

>— ^ ' in input correlation. 
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en , The recent advent of novel recording techniques made it easier to simultaneously record from large number of neurons 

Cn ■ and provided new possibilities to relate population activity to coding and information processing in the braini'^. Many 
^_^ \ researchers suggest that studying the correlated activity of neurons in a population is essential for understanding how 
r ^ . the information are coded in the brain2,^J,. Correlated spiking of neurons contributes in several cognitive functions such 
as attention^-, sensory codingiir— and discriminatio n^^d^ , motor behavior— and population codingSi d^'^" . Besides 
functional effects of such correlations between populations of neurons on neural coding, understanding how different 
O ' parameters such as biological, network or stimulus parameters tune them is eventually being revealed^ ^^^^. Correlation 
between neuronal activities is measured frequently by pairwise correlation coefficients and spike count correlations and 
ability of a neuronal system to transfer correlation can be quantified by correlation transfer function (CTF), which 
0"^| determines the relation between output correlation of a system under stimulus with specific input correlatiorii^^— . 

A periodic common input on two (or more) uncoupled oscillators can cause a coherent behavior when both the 
^-H ' oscillators lock to the external force^^. A very common example is the control of circadian rhythms of human/animals 
J> , by the light-dark stimulation^^. In case of noisy inputs the counterpart of the phenomena appears as stochastic 
l/~J ' synchronization (SS) which is a general topic that addresses the phenomenon of irregular phase locking between 
OC , two noisy non-linear oscillators^. In nervous systems, cross-correlations can arise either from the presence of direct 
synaptic connections^!^ or from shared inputs from the surrounding network or sensory layers^^ii^ii^^. While effect 
of direct synaptic connections and common inputs are vastly studied, less attention has been paid to the interplay of 
\l ■ the two sources of correlation while they can be present concurrently in many physical and biological systems. We 
^^ ' will show several nontrivial results can arise when two neurons with direct synaptic connections, are subjected to 
common/correlated inputs. 

Possible differences between intrinsic parameters of neurons, causes the message from environment to the system 
to be decoded differently by the system individuals. Another aim of the current study is to investigate how the 
correlation is transferred by two neurons when the neurons are not identical. In such a heterogeneous system, the 
»2j [ temporal symmetry of spike correlation is lost^^. We will show that even an slight inhomogeneity in the intrinsic 
C^ . parameters can lead to large reduction of pairwise correlation coefficient in the case of uncoupled neurons. As it is 
expectable the results depend on the time scales on which the correlation is calculated: Spike count correlations over 
long time bins are less affected by the heterogeneity but synchrony - alignment of action potential in small time bins- 
is tightly dependent on the homogeneity of the system. 

We have shown that correlated inputs and direct connections can either show cooperative or competing effects in 
different ranges of parameters. For uncoupled neurons, correlation susceptibility increases by increasing amplitude 
of noise for mildly correlated input o^^i^^'^^ . Our results show that when direct connections are present between 
nonidentical neurons, the mean susceptibility is not anymore a monotonic function of amplitude of correlated noisy 
input. Reminiscence of stochastic resonance phenomena (SR), an intermediate noise amplitude in this case leads to 
larger sensitivity of the system to the changes in input correlation. We have also shown that with monosynaptic 
connections between two neurons, nonidentical neurons can show more correlation comparing to similar neurons. 
It means that with unidirectionally connections, slight inhomogeneity can increase the correlation of spike trains. 
Changing mismatch and synaptic strengths between two neurons, it is possible to change the functional form of 
correlation transfer function to optimize the mean susceptibility which is indicator of the sensitivity of the system to 
the change of input correlation in different ranges. In this way, as the most important result of current study, we 
will show that with direct couplings it is possible to detect correlation in small amplitude noises by increasing the 



sensitivity of the system to the change of correlation in the small amplitude noisy inputs. 



II. MATERIAL & METHODS 



The system under investigation consists of two coupled leaky integrate and fire (LIF) neuronsSI, subjected to 
correlated stochastic inputs. Subthreshold dynamics of the neuron in the LIF model obeys the following first order 
equation: 



dvj 



V„ 



h 



(2.1) 



in which Vi is a voltage-like variable for each neuron labeled by i = 1, 2 with t„i — 20 ms and Vrest — —70 mV. A 
severe nonlinearity is imposed on the model by considering a threshold value Vth — —54 mV. Whenever this value is 
reached, the neuron spikes and the voltage resets to Vreset = —60 mV. (Parameters taken from^). The spikes of the 
neurons are recorded as xi (t) — J2m ^(^ ~ ^T) where tf is the time of m*'* spike of the neuron i, and S{x) is the Dirac 
delta function. 

Each model neuron receives a synaptic current through the direct connection from the other neuron /y-, and an 
external current li representing the sensory input or the effect of the surrounding networks. In the model equations, 
external current to the neuron i comprises a constant (dc) and a stochastic component with amplitude a. The 
stochastic inputs are sum of a common component ^c (t) and an individual component ^i (t) : 



hit) ^{l±d)I + a [VT^^^{t) + V^Ut)] , 



(2.2) 




FIG. 1: Schematic representation of the model. Two neurons stimulated by common and independent components, are 
possibly connected together by direct excitatory synaptic connections. Correlation of spike trains is then calculated over time 
bins much smaller than the mean inter-spike intervals. 

where ^dt) and Ciit) ^-re mutually independent Gaussian stochastic processes with zero mean and unit variance 
{^i{t)^j{t')) — 5ij5{t — t'). The parameter c € [0, 1] determines correlation of external currents which will be referred 
to as the input correlation. With the minimal model we used, inhomogeneity in the intrinsic activity rates is imposed 
by different constant currents which are chosen as /i = (1 + 5)1 and /2 == (1 — 5)1 , where 5 is referred to as the 
parameter of inhomogeneity. With nonzero 5 the neurons 1 and 2 will be the high frequency (fast) and low frequency 
(slow) neurons, respectively. 

Neurons are pulse coupled. The neuron i receives a pulse by the strength A^- every time the neuron j fires, so 
the synaptic current in Eq. 12.11 can be written as hj = AijXj{t) where the synaptic strength Ay can be positive 
(excitatory) or negative (inhibitory). For convenience, we call the connections 21 and 12, the forward and backward 
connections, respectively. Note that although the external and synaptic inputs appear as currents, they are actually 
measured in units of the membrane potential (mV) since a factor of the membrane resistance has been absorbed into 
their definition. 

Co-fluctuations in the activity of neurons are measured over a range of timescales (for a review see-). Spike count 
correlation is usually measured over the time scales from tens of milliseconds to seconds, while synchrony, that is 



almost precise alignment of the spikes, is measured over the time scale of the typical width of an action potential. It 
has been shown that spike comit correlation over the small bins, bins of the order of one millisecond, can be largely 
determined by zero-lag conditional firing rate which quantifies exact synchrony^. In this study we focus on synchrony, 
by describing spike counts and correlation coefficients in discrete bins of duration T — 0.5 ms (unless otherwise noted). 



Correlation coefficient of spike counts ni{t) — J^ 
and n2- 
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Xi{s)ds, is defined as the zero lag cross-correlation between ni 



PT 



{ni(t)n2{t)) - {ni{t)){n2{t)) 



^{n,{tY)-{n,{t)Y^{n2itf)-{n2{t)y 



(2.3) 



Correlation transfer function (CTF) is commonly used as a measure of dependence of the output correlation to 
the input correlation for a multi-element dynamical syste m^^'^^ . To study sensitivity of correlation of output spike 
trains to the change of input correlation, we use differential correlation susceptibility (DCS) as the mean slope of the 
correlation transfer function in a given range of c € [ci, C2]: 



St{ci,C2) 



Ac 



(2.4) 



which shows ratio of the change of correlation of spike trains Apr = Pt{c2) — Pt{ci) to the change of input correlation 
Ac = C2 — ci . For two identical neurons with no direct connection, this value is equal to one when it is evaluated over 
the full range of input correlation [0, 1]. 




FIG. 2: Correlation of spike trains for two uncoupled neurons. (A) Correlation coefficient is plotted against inho- 
mogeneity, the mismatch between input current of neurons, for different values of input correlation. (B) Correlation transfer 
function CTF is plotted for different values of inhomogeneity. (C,D) The results are shown for a larger value of noise amplitude 
but with the same mean firing rate as (A,B) (see methods). (E) Differential correlation susceptibility (DCS) is plotted for 
homogeneous and slightly inhomogeneous system, as a function of noise amplitude, which shows the mean sensitivity of the 
output correlation to the change in input correlation over the range [0,0.5]. 



III. RESULTS 

We first give the results for two uncoupled neurons. In Fig. 2A we have shown cross-correlation coefficient as a 
function of mismatch between intrinsic firing rates of neurons for low noise amplitude and different values of input 
correlation. When there is no direct connection between the neurons, highly correlated inputs lead to large output 
correlation in case of identical neurons. Even a small mismatch decreases the output correlation considerably if the 
noise is low amplitude. In this case, even common noises lead to relatively low output correlations in presence of 
small inhomogeneity (e.g. 5 = 0.01) (Fig. 2A). For larger noise amplitudes, the output correlation is less sensitive to 
inhomogeneity (Fig. 2B). The system is also less sensitive to inhomogeneity when the inputs are weakly correlated 
since both homogeneous and inhomogeneous systems have small output correlation. In Figs. 2C and 2D we have 
shown the correlation transfer function. It can be seen that while the slope of correlation transfer function decreases 
with mismatch for all the values of input correlation, this dependence is only considerable for highly (completely) 
correlated inputs. Increasing noise amplitude (while decreasing the constant input to avoid change in mean firing rate 
as explained below) makes the output correlation less sensitive to inhomogeneity for highly correlated inputs but yet 
the maximum sensitivity to the mismatch is seen for highly correlated inputs (Fig. 2D). 

It has been previously shown that spike train correlation increases with firing rat o^^i'^^ . As noted above to avoid 
the results to be affected by the change in firing rate, we decreased mean value of input current while increasing 
the amplitude of fluctuations. The results shown in Figs. 2 and 3 are produced in such a way with a roughly 
constant mean value of firing rate ~ 63Hz. The mean value of the slope of the CTF over a given range of input 
correlations can quantify the average sensitivity of the spike train correlation to the correlation of inputs. In Fig. 2E 
we have plotted the DCS (mean slope of the correlation transfer function as described in methods) as a function of 
the amplitude of stochastic input for two uncoupled neurons over the range c e [0 — 0.5]. The results for other ranges 
of partially correlated inputs are similar, i.e., the system shows low sensitivity to the change in input correlation for 
small amplitude noises and the sensitivity smoothly increases with increasing noise amplitudes. Just for the identical 
neurons if the full range of input correlation is considered (c G [0—1]), the mean slope would be trivially equal to 
unity, independent of the noise amplitude. 

These results show that the correlation between the low amplitude noises can not be suitably detected by a system 
of uncoupled neurons. To investigate the effect of direct couplings we have first considered a two neuron motif with 
just one unidirectional excitatory coupling. In many cases this configuration is favored when the synapses change 
through spike timing-dependent plasticity**'. We considered an excitatory forward coupling: From the high frequency 
(as the presynaptic) to low frequency neuron (as the postsynaptic) (see methods). In the absence of noise, any finite 
value of forward coupling strength can lead to a zone of 1 : 1 synchrony, in which the dissimilar neurons fire in causal 
master-slave fashion**^'*^. In the causal limit the postsynaptic neuron fires immediately after receiving presynaptic 
stimulation^!^. In our model delays in communication have been ignored, so in causal 1 : 1 synchrony zones, the 
postsynaptic neuron fires just one simulation time step after firing of presynaptic neuron. Since the time bin on which 
the correlation is calculated contains several time steps (see methods) , such a causal master-slave firing leads to p = 1 
(Figs. 3A and 3B with no noise). Stochastic inputs have nontrivial effects on the correlation of the spike trains of 
these two neurons system. The output correlation is not anymore a monotonically decreasing function of mismatch, 
and namely a small mismatch can increase output correlation for correlated inputs (Figs. 3A and 3B). 

For coupled neurons, both the direct coupling and correlated inputs affect the correlation of spike trains and 
interesting effects can be seen when both the sources of correlation are present. Intuitively, the relative amplitudes of 
noise and recurrent stimulations determine the behavior of the system and the most notable results can be expected 
when the two sources are of the same order, i.e., when neither the external noise nor recurrent stimulations are 
dominant. In Figs. 3C and 3D we have shown CTF to inspect the effect of changing correlation of the stochastic 
inputs on correlation of spike trains for fixed value of synaptic strength. When the noise amplitude is not large, 
depending on the mismatch, different correlation transfer functions can be observed (Fig. 3C). Notably with changing 
mismatch it is possible to generate, for example, a CTF with higher sensitivity on the input correlation in different 
ranges of input correlation, or, a CTF with negative slope. Since firing rate can be changed by the mean synaptic 
inputs, it is possible that the coordinated response of the coupled neurons in a pool, to change over the time when 
their mean input change, say, in different levels of consciousness. In a different timescale, changes of synaptic strength 
through plasticity can also affect CTF for a given amplitude of noise. 

As noted above, high level of stochastic input can wash out the effect of direct couplings and make the system to 
respond more similar to uncoupled neurons (see e.g. Fig. 3D). Impact of direct connections on the detection of input 
correlation of low amplitude noisy inputs is more apparent in a plot of DCS. In Fig. 4A we have plotted 5t(0,0.5) 
as a function of noise amplitude for several values of synaptic strength, for unidirectionally coupled nonidentical 
neurons (with a small mismatch). Such an asymmetric (unidirectional) coupling has a crucial effect on DCS when 
it connects slightly different neurons (see also Fig. 4D and explanation below). As is shown in Fig. 4A, a forward 
monosynaptic connection (fi'om high frequency to low frequency neuron) can considerably change the performance 
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FIG. 3: Correlation of spike trains for coupled neurons. (A-D) All the results shown in Fig. 2 are repeated for two 
neurons, when the neurons are connected by a forward excitatory connection (from the high-frequency to the low-frequency 
neuron) of the strength A21 = 1. The black curves in (A) and (C) correspond to autonomous case when no stochastic input 
is present. 



of the heterogeneous system in detecting variable input correlation. In an intermediate synaptic strength (A21 — 
1) DCS shows faster growth in low amplitude noises and a higher maximum in relatively small amplitude noises. 
Further increasing of synaptic strength and noise amplitude reduces the performance of the system in detection 
of input correlation. With very large noise amplitudes, not presented in the figures, expectedly the effect of the 
direct connections is washed out and all the curves, including that of the uncoupled neurons, merge together and 
DCS smoothly increases with noise amplitude. Depending on the mismatch, there is an optimum value of synaptic 
strength which maximizes the mean sensitivity of correlation of spike trains to the input correlation. In Fig. 3C 
we have shown DCS as a function of the strength of forward unidirectional coupling for three values of mismatch. 
Expectedly, optimum value of synaptic strength is larger when the intrinsic firing rate of neurons are further different. 

Overall increase of correlation of the spike trains is an intuitive expectation when direct couplings are present in 
the systems. But how direct couplings can increase the sensitivity on the changes in input correlation? Results shown 
in Fig. 3B indicate that the degree of amplification of output correlation depends on input correlation. A suitable 
choice of synaptic strength would result in more amplification for higher input correlations and increase the slope 
of correlation transfer function. Note that how very large synaptic strength decreases the sensitivity, due to the 
over-amplification of spike train correlation in small values of input correlation. 

So far the results are shown when just a unidirectional excitatory coupling is present which is directed to low 
frequency neuron, and the neurons are nonidentical. To test other configurations, and to find the best configuration 
through which direct couplings can improve the performance of the system in detection of variable input correlation, 
we have tested mutual couplings with different ratios of forward A21 and backward A12 connections. While the sum 
of synaptic strengths are kept constant, different configurations can be designed by changing the ratio of coupling 
constants r = A21/A12 (Figs. 4D and 4E). In absence of mismatch, best configuration is that preserves symmetry, 
i.e., the best performance is resulted with equal forward and backward couplings. On the other hand, in presence of 
mismatch, an asymmetric arrangement of couplings in which the forward coupling (from the high frequency neuron) 



is larger, improves performance of the system. Interestingly, asymmetric excitatory couplings in favor of backward 
coupling (from the low frequency neuron), significantly decreases the sensitivity of the system. 
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FIG. 4: Differential correlation susceptibility. (A) DCS is plotted vs. noise amplitude for two unidirectionally coupled 
nonidentical neurons {5 = ...). The results are shown for different values of synaptic strength. Maximum value of sensitivity 
to low amplitude noises can be obtained by an intermediate synaptic strength indicated in the figure. The dashed line shows 
the value of noise amplitude in (C)-(E). (B) Correlation transfer function is plotted for different values of synaptic strength. 
Shadings are guide to eye for a comparison of the mean slope of the CTF for two different values of synaptic strength. (C) DCS 
is shown as a function of synaptic strength for different value of mismatch. The optimum value for synaptic strength grows 
for larger mismatch. (D,E) different configurations of couplings are tested for identical and nonidentical neurons, respectively. 
Different curves are plotted for different ratios r of forward and backward couplings indicated in the legends. In (D) the neurons 
are identical and symmetric configuration r = 1 shows the best performance with a suitable choice of synaptic strengths. In 
(E) nonidentical neurons have been tested: When the imbalance of couplings is in favor of forward coupling (from the high 
frequency neuron) the sensitivity considerably improves. When the backward coupling is larger r < 1, the system performance 
is quite poor. As is shown in axes labels, DCS is calculated over the range [0, 0.5] of input correlation. 



IV. DISCUSSION 



Both direct connections and common inputs can be source of correlation in the activity of neurons in nervous 
systems. While a large amount of literature has devoted to the effects of common inputs and direct connections^"—, 
less attention has been paid to the simultaneous effects of common inputs and direct connections^. In this study we 
have numerically inspected effect of stochastic correlated inputs on the correlation of spike trains of two coupled LIF 
neurons. To study the system in a more general framework, we have considered the neurons with different intrinsic 
firing rates. We have assumed neurons with equal membrane time constants and inhomogeneity imposed on the 
system by feeding the neurons with different constant currents. The inhomogeneity, determined by the difference 
in the mean input currents, along with synaptic strengths are the key-paranreters which specify the response of the 
system to the stochastic inputs. 

While for uncoupled neurons, output correlation is a monotonically decreasing function of inhomogeneity, for 
coupled neurons with low noise amplitudes, spike trains correlation can be increased by increasing inhomogeneity in 
some ranges. This result holds for sufficiently small noise amplitudes and the system inherits this property from n : m 
locking zones for the autonomous system when there is no stochastic input present. This introduces inhomogeneity 
as an important parameter with nontrivial impact on the correlation of spike trains in coupled systems. 

Another feature of the system is that the two sources of correlation, correlated inputs and direct connections, do 
not necessarily cooperate in formation of correlated spike trains. Correlation transfer function determines the relation 
of output correlation to the input correlation, and its slope characterizes the sensitivity of the system to the change 
of input correlation. For uncoupled systems CTF is a monotonically increasing function and its slope decreases with 
lowering noise amplitudeS^i^ (if the inputs are not highly correlated) and with increasing mismatch (see Figs. IC and 



D With different choices of synaptic strengths and inhomogeneity, it is possible to change CTF and design a system 
with different sensitivity to the input correlation. In particular, it is possible to design the system with negative 
mean slope of CTF, showing a case with destructive effect of common noises on the correlation of spike trains, and, 
the slope of CTF can be maximized in a range of input correlation. The latter proposes that direct connections can 
increase the sensitivity of the system to the correlation of the neuron's stochastic inputs, specially when the noises are 
low amplitude. We have further shown that for homogeneous system, with identical neurons, the best configuration 
of couplings which maximizes the mean sensitivity of the system in a given range, is a symmetric configuration, i.e., 
equal coupling constants. On the other hand, in presence of inhomogeneity, an asymmetric configuration in which 
the synaptic constant from the high frequency neuron to the low frequency is larger, improves sensitivity. In either 
case, there is an optimum value of synaptic constant which maximizes the sensitivity. 

Competitive learning through classical spike timing-dependent plasticity (STDP) in feed-forward networks leads 
to potentiation of the synapses which convey correlated data and depression of those with uncorrclated activitj^. 
How STDP changes the lateral connections transverse to the path of data flow? It has been shown that in recurrent 
networks asymmetric connections arise through STDP and in presence of inhomogeneity, asymmetric change is in favor 
of the connection from the high frequency to low frequency neuro n^^'^^ . Our results show that asymmetric connections 
can enhance the performance of inhomogeneous systems in detection of input correlation, and interestingly such an 
optimum configuration of connections emerges through STDP (with asymmetric profile) in inhomogeneous neuronal 
pools''^. 

Type of neuronal excitability, shape of the phase resetting curves (PRCs), can also affect the correlation transfer in 
neuronal pools^"— . Phase resetting curve characterizes how small perturbations influence the oscillator's subsequent 
timing or phase. It has been recently shown that type-II neurons with both negative and positive regions in their 
PRCs, transfer correlations more faithfully when the correlation is calculated over short time bins (— ). Although it 
needs further investigation but since the phase of a LIF neuron always advances in response to the external pulses, 
the results for LIF neurons are likely to apply for type-I neurons. 

Correlation of spike trains over such small time bins we have used T — O.Sttis, is a measure of (almost) precise 
alignment of action potentials. Similar outputs resulted when we repeated the experiments with T — \ms but we 
expect qualitatively different results when correlation of spike counts is measured over the time scales, comparable, or 
larger than the mean inter-spike interval. Less sensitivity to inhomogeneity is expected when correlation is evaluated 
over large time bins, but effect of direct couplings warrants for further studies to find out if correlation in small 
amplitude stochastic inputs can be revealed in co- variation of spike trains of coupled neurons in large time scales. 
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